Mixture of Vector Experts
نویسندگان
چکیده
We describe and analyze an algorithm for predicting a sequence of n-dimensional binary vectors based on a set of experts making vector predictions in [0, 1]. We measure the loss of individual predictions by the 2-norm between the actual outcome vector and the prediction. The loss of an expert is then the sum of the losses experienced on individual trials. We obtain bounds for the loss of our expert algorithm in terms of the loss of the best expert analogous to the well-known results for scalar experts making real-valued predictions of a binary outcome.
منابع مشابه
Support vector mixture for classification and regression problems
In this paper, we study the incorporation of the support vector machine (SVM) into the (hierarchical) mixture of experts model to form a support vector mixture. We show that, in both classification and regression problems, the use of a support vector mixture leads to quadratic programming (QP) problems that are very similar to those for a SVM, with no increase in the dimensionality of the QP pr...
متن کاملRelevance Vector Machine based Mixture of Experts
The aim of this report is to detail the implementation of a sparse Bayesian Mixture of Experts (ME) [2] for solving a one-to-many regression mapping based on the relevance vector machine architecture. Our eventual goal is to evaluate the ME framework in human body and hand pose estimation from monocular view. However, this is left for future work. The application of ME is demonstrated using a t...
متن کاملMixture of experts for classification of gender, ethnic origin, and pose of human faces
In this paper we describe the application of mixtures of experts on gender and ethnic classification of human faces, and pose classification, and show their feasibility on the FERET database of facial images. The FERET database allows us to demonstrate performance on hundreds or thousands of images. The mixture of experts is implemented using the "divide and conquer" modularity principle with r...
متن کاملMixtures of Experts Estimate a Posteriori Probabilities Mixtures of Experts Estimate a Posteriori Probabilities
The mixtures of experts (ME) model ooers a modular structure suitable for a divide-and-conquer approach to pattern recognition. It has a probabilistic interpretation in terms of a mixture model, which forms the basis for the error function associated with MEs. In this paper, it is shown that for classiication problems the minimization of this ME error function leads to ME outputs estimating the...
متن کاملInfinite support vector machines in speech recognition
Generative feature spaces provide an elegant way to apply discriminative models in speech recognition, and system performance has been improved by adapting this framework. However, the classes in the feature space may be not linearly separable. Applying a linear classifier then limits performance. Instead of a single classifier, this paper applies a mixture of experts. This model trains differe...
متن کاملInvestigation of Mixture of Experts Applied to Residential Premises Valuation
Several experiments were conducted in order to investigate the usefulness of mixture of experts approach to an online internet system assisting in real estate appraisal. All experiments were performed using real-world datasets taken from a cadastral system. The analysis of the results was performed using statistical methodology including nonparametric tests followed by post-hoc procedures desig...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2005